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(57) Abstract: The data structure recorded on the recording medium includes a playlist file. The playlist file includes navigation 
information for reproducing still images and audio data together as a slideshow. 
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RECORDING MEDIUM HAVING DATA STRUCTURE FOR 
MANAGING REPRODUCTION OF SLIDESHOWS RECORDED 
THEREON AND RECORDING AND REPRODUCING METHODS AND 

APPARATUSES 

5 1. TECHNICAL FIELD 

The present invention relates to a recording medium having 
a data structure for managing reproduction of at least still images 
recorded thereon as well as methods and apparatuses for 
reproduction and recording, 

10 2. BACKGROUND ART 

The standardization of new high-density read only and 
rewritable optical disks capable of recording large amounts of 
high-quality video and audio data has been progressing rapidly and 
new optical disk related products are expected to be commercially 

15 available on the market in the near future. The Blu-ray Disc 
Rewritable (BD-RE) and Blu-ray Disk ROM (BD-ROM) are examples of 
these new optical disks. 

The standardization for high-density read-only optical disks 
such as the Blu-ray ROM (BD-ROM) is still under way. An effective 

20 data structure for managing reproduction of still images recorded 
on the high-density read-only optical disk such as a BD-ROM is not 
yet available. 

3 . DISCLOSURE OP INVENTION 

The recording medium according to the present invention 
25 includes a data structure for managing reproduction of at least 
still images recorded on the recording medium as a slideshow. 

In one exemplary embodiment, a playlist file recorded on the 
recording medium includes a playlist file having navigation 
information for reproducing still images and audio data together 
30 as a slideshow. In one embodiment, the navigation information links 
the still images and audio data such that presentation of the still 
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images is synchronized with reproduction of the audio data. In 
another embodiment, the navigation information links the still 
images and audio data such that reproduction of the audio data 
occurs independently of presentation of the still images. 
5 In one embodiment, the navigation information indicates a 

duration to display each still image during reproduction of the 
slideshow. For example, the duration may indicate a finite or 
infinite display time. In one embodiment, when an infinite display 
time is indicated, the still image is displayed until user input 

10 instructing a change from the still image is received. 

In one exemplary embodiment, the playlist file includes one 
of a playitem field and a sxib-playitem field providing the 
navigation information for the still image file. According to a 
further exemplary embodiment, another one of a playitem field and 

15 a sub-playitem field provides navigation information for the audio 
data. In another exemplary embodiment, the playlist file includes 
mark information, and the mark information includes a mark 
associated with a point in the audio data and which points to the 
still picture. 

20 The present invention further provides apparatuses and 

methods for recording and reproducing the data structure according 
to the present invention, and recording and reproducing slideshows 
according to the present invention. 

4. BRIEF DESCRIPTION OF DRAWINGS 

25 The above features and other advantages of the present 

invention will be more clearly understood from the following 
detailed description taken in conjunction with the accompanying 
drawings, in which: 

Fig. 1 illustrates an exemplary embodiment of a recording 
30 medium file or data structure according to the present invention; 

Fig. 2 illustrates an example of a recording medium having 
the data structure of Fig. 1 stored thereon; 
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Fig. 3 illustrates a method of managing still images for a 
high-density optical disk in accordance with one embodiment of 
the invention; 

Fiq\ 4 illustrates a method of managing still images for a • 
5 high-density optical disk in accordance with another exemplary 
embodiment of the invention; 

Fig. 5A illustrates one exemplary method of managing still 
images in accordance with an exemplary embodiment of the 
invention; 

10 Fig. 5B illustrates one exemplary method of managing still 

images and video presentation units (VPUs) in accordance with an 
exemplary embodiment of the invention; 

Fig.' 6 illustrates one exemplary embodiment of the 
navigation information for still images provided by associated 
15 playlist marks; 

Figs. 7A-7C illustrate other exemplary embodiments of the 
navigation information for still images and/or VPUs provided by 
associated playlist marks; 

Fig. 8A illustrates another exemplary embodiment of a method 
20 of managing still images according to the present invention; 

Fig. 8B illustrates another exemplary embodiment of a method 
of managing still images and VPUs according to the present 
invention; 

Fig. 9A illustrates an exemplary embodiment of the 
25 navigation information for still images provided by a still 
indicator information field; 

Fig. 9B illustrates an exemplary embodiment of the 
navigation information for still images and VPUs provided by a 
slideshow indicator information field; 
30 Fig. 10 illustrates another exemplary embodiment of a method 

for managing still images according to the present invention; 

Figs. IIA and 118 each illustrate an exemplary embodiment 
of the playitem information field according to the present 
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invention; 

Fig. 12A illustrates another exemplary embodiment of a 
method for managing still images according to the present 
invention; ..... 
5 Fig. 12B illustrates another exemplary embodiment of a 

method for managing still images and VPUs according to the present 
invention; 

Figs. 13A and 13B each illustrate an exemplary embodiment 
of the sub-playitem information field according to the present 
10 invention; 

Fig. 14A illustrates a method of recording still information 
packets for identifying still display positions in accordance 
with an exemplary embodiment the invention; 

Fig. 14B illustrates a method of recording slideshow 
15 information packets for identifying display positions in 
accordance with an exemplary embodiment the invention; and 

Fig. 15 illustrates a method of recording still information 
packets for identifying still display positions in accordance 
with another exemplary embodiment the invention; 
20 Fig. 16 illustrates a schematic diagram of an embodiment of 

an optical disk recording and reproduction apparatus of the present 
invention; 

Figs. 17-19 illustrate examples of synchronized or 
time-based slideshows; and 
25 Fig. 20 illustrates an example of a browsable slideshow. 

5. MODES FOR CARRYING OUT THE INVENTION 

In order that the invention may be fully understood, 
exemplary embodiments thereof will now be described with reference 
to the accompanying drawings. 
30 A high-density optical disk, for example, a Blu-Ray ROM 

(BD-ROM) , BD-RE, etc. in accordance with the invention may have 
a file or data structure for managing reproduction of video and 
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audio data as shown in Fig. 1. Some aspects of the data structure 
according to the present invention shown in Fig. 1 are the same 
as the well-known BD-RE standard, as such these aspects will not 
be described in great detail. 
5 As shown in Fig. 1, the root directory contains at least one 

BD directory. The BD directory includes general files (not shown) , 
a PLAYLIST directory in which playlist files (e.g., *.mpls) are 
stored, a CLIPINF directory in which clip information files 
(*.clpi) are stored, and a STREAM directory in which 

10 MPEG2- formatted A/V stream clip files (*.m2ts), corresponding to 
the clip information files, are stored. 

The STREAM directory includes MPEG2- formatted A/V stream 
files called clips or clip files. The A/V stream includes source 
packets of video and audio data. For example, a source packet of 

15 video data includes a header and a transport packet . A source packet 
includes a source packet number, which is generally a sequentially 
assigned number that serves as an address for accessing the source 
packet. Transport packets include a packet identifier (PID) . The 
PID identifies the sequence of transport packets to which a 

20 transport packet belongs. Each transport packet in the sequence 
will have the same PID. 

The CLIPINF directory includes a clip information file 
associated with each A/V stream file. The clip information file 
indicates, among other things, the type of A/V stream associated 

25 therewith, sequence information, program information and timing 
information. The sequence information describes the arrival time 
basis (ATC) and system time basis (STC) sequences. For example, 
the sequence information indicates, among other things, the number 
of sequences, the beginning and ending time information for each 

30 sequence, the address of the first source packet in each sequence 
and the PID of the transport packets in each sequence. A sequence 
of source packets in which the contents of a program is constant 
is called a program sequence. The program information indicates, 

5 
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among other things, the number of program sequences, the starting 
address for each program sequence, and the PID(s) of transport 
packets in a program sequence. 

The timing information is referred to as characteristic point 
5 information (CPI) . One form of CPI is the entry point (EP) map. 
The EP map maps a presentation time stamp (e.g. , on an arrival time 
basis (ATC) and/or a system time basis (STC)) to a source packet 
address (i.e. , source packet number) . The presentation time stamp 
(PTS) and the source packet number (SPN) are related to an entry 

10 point in the AV stream; namely, the PTS and its related SPN point 
to an entry point on the AV stream. The packet pointed to is often 
referred to as the entry point packet. 

The PLAYLIST directory includes one or more playlist files. 
The concept of a playlist has been introduced to promote ease of 

15 editing/assembling clips for playback. A playlist file is a 

collection of playing intervals in the clips. Each playing interval 
is referred to as a playitem. The playlist file, among other things, 
identifies each playitem forming the playlist, and each playitem, 
among other things, is a pair of IN-point and OUT-point that point 

20 to positions on a time axis of the clip (e.g., presentation time 
stamps on an ATC or STC basis) . Expressed another way, the playlist 
file identifies playitems, each playitem points to a clip or 
portion thereof and identifies the clip information file 
associated with the clip. The clip information file is used, among 

25 other things, to map the playitems to the clip of source packets. 

The general information files (not shown) provide general 
information for managing the reproduction of the A/V streams 
recorded on the optical disk. 

In addition to illustrating the data structure of the 

30 recording medium according to an embodiment of the present 

invention. Fig. 1 represents the areas of the recording medium. 
For example, the general information files are recorded in one or 
more general information areas, the playlist directory is recorded 

6 
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in one or more playlist directory areas, each playlist in a playlist 
directory is recorded in one or more playlist areas of the recording 
medium, etc. Fig. 2 illustrates an example of a recording medium 
having the data structure of Fig. 1 stored thereon. As shown, the 
5 recording medium includes a file system information area, a data 
base area and an A/V stream area. The data base area includes a 
general information file and playlist information area and a clip 
information area. The general information file and playlist 
information area have the general information files recorded in 

10 a general information file area thereof, and the PLAYLIST directory 
and playlist files recorded in a playlist information area thereof . 
The clip information area has the CLIPINFO directory and associated 
clip information files recorded therein. The A/V stream area has 
the A/V streams for the various titles recorded therein. 

15 Video and audio data are typically organized as individual 

titles; for example, different movies represented by the video and 
audio data are organized as different titles. Furthermore, a title 
may be organized into individual chapters in much the same way a 
book is often organized into chapters. 

20 Because of the large storage capacity of the newer, 

high-density recording media such as BD-ROM and BD-RE optical disks, 
different titles, various versions of a title or portions of a title 
may be recorded, and therefore, reproduced from the recording media. 
For example, video data representing different camera angles may 

25 be recorded on the recording medium. As another example, versions 
of title or portions thereof associated with different languages 
may be recorded on the recording medium. As a still further example, 
a director's version and a theatrical version of a title may be 
recorded on the recording medium. Or, an adult version, young adult 

30 version and young child version (i.e., different parental control 
versions) of a title or portions of a title may be recorded on the 
recording medium. Each version, camera angle, etc. represents a 
different reproduction path, and the video data in these instances 

7 
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is referred to as multiple reproduction path video data. 

Because of the large storage capacity of the newer, 
high-density recording media such as BD-ROM still images may be 
-recorded and reproduced in an organized and/or user interactive 
5 fashion, for example, as slideshows. The data structure for 
managing reproduction of still images for a high-density optical 
disk in accordance with embodiments of the present invention will 
be described along with methods and apparatuses according to 
embodiments of the present invention for recording and 

10 reproducing still images. 

Fig. 3 illustrates a method of managing still images for a 
high-density optical disk in accordance with one embodiment of 
the invention. In this embodiment, a plurality of still images 
are recorded as a still image file on a BD-ROM and the plurality 

15 of still images stored in the still image file are linked to 
specific navigation information of a playlist including 
navigation information for playback control of still images. The 
specific navigation information linked to the still images is 
linked to specific movie video data contained in a clip A/V stream 

20 storing movie video and audio data. 

As depicted in Fig. 3, a plurality of still images can be 
linked to one recording position. The plurality of still images 
can be displayed in various ways, for example, by a sequential, 
a random/shuffle, or an automatic/manual slideshow. The various 

25 display options will be described in greater detail below. 

Fig. 4 illustrates a method of managing still images for a 
high-density optical disk in accordance with another exemplary 
embodiment of the invention. This embodiment is the same as the 
embodiment of Fig. 3 except the clip A/V stream only contains audio 

30 data. In this case, while playing the audio data, the optical disk 
reproducing apparatus detects still images linked to specific 
recording positions of the audio data and performs a still 
operation that outputs the detected still images together with 

8 
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the audio data. 

According to the embodiments of the present invention, movie 
data (e.g., video or video and audio) and still images or audio 
data and still images may be provided to a user through, for 
5 example, a television set connected to an optical disk reproducing 
apparatus such as discussed in detail below. Methods of managing 
navigation information for linking still images to the movie or 
audio data will now be described in detail. 

Fig. 5A illustrates one exemplary method of managing still 

10 images in accordance with an exemplary embodiment of the invention. 
In this embodiment, one or more playlist marks are defined for 
managing still images. As shown in Fig. 5A, a still image or a 
group of still images is linked to a playlist by a playlist mark, 
referred to as a still mark. In this manner, the still images may 

15 be managed as a slideshow as described in more detail below. The 
playlist marks are described in greater detail below with respect 
to Figs. 6-7. 

Fig. 6 illustrates one exemplary embodiment of the 
navigation information for still images provided by associated 

20 playlist marks. A playlist file includes a playlist mark 

information field called ^PlayList Mark' . As shown in Fig. 6, the 
playlist mark ' PlayListsMark' information field indicates a length 
of the information field and a number of the playlist marks 
'number_of_PlayList_marks' in the playlist. In case of the BD-RE, 

25 the 'length* field has a value of '26 bytes' . In case of the BD-ROM 
in accordance with the invention the length field may have a value 
greater than 26 bytes. For each playlist mark, the playlist mark 
^PlayListsMark' information field indicates the mark type 
*mark_type' , a time stamp ' market ime_s tamp' , duration ^duration' , 

30 maker's information * maker s_informat ion ' , and maker's name 
* make rename' . 

The mark type indicates the type of mark. For example, when 
a mark . indicates the beginning of a chapter, the mark type 

9 
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'mark_type' identifies the associated mark as a chapter mark. As 
further shown in Fig. 6, if a mark is of the still type, then an 
index number of the associated still image or images recorded on 
the BD-ROM *ref_to_still_image2;index' is provided. 
5 The time stamp 'mark_time_stamp' of the mark indicates a 

point where the mark is placed; namely, indicates a point on a time 
axis of the A/V stream of clips (e.g., ATC and/or STC basis) where 
the mark is placed. The * duration' indicates the length of the mark 
that starts from the time stamp indicated by the 'mark_time_stamp' . 

10 If the mark is a still mark, then the duration ^duration' may 
indicate a length of time to display the still image. 

The maker's information 'maker_information' provides 
information supplied by the maker, and the maker's name 
'maker_name' gives the maker's name. 

15 As demonstrated from the description of Fig. 6, when a mark 

is a still mark, the information associated with the still mark 
provides navigation information for reproducing the still image 
associated with the still mark. 

Fig. 7A illustrates another exemplary embodiment of the 

20 navigation information for still images provided by associated 
playlist marks. As shown, this embodiment is the same as the 
embodiment of Fig. 6 except that if the mark is a still mark (e.g. , 
mark type =0x10) then additional information regarding the 
reproduction of the still image or images is provided in 

25 association with the still mark. Specifically, the following 
indicator fields are provided: an indicator of the number of still 
images associated with the still mark *number_of_still_images' , 
an indicator of the display timing 'display_timing_mode' , an 
indicator of the display order * display _order_mode' , an indicator 

30 of the display effect ^display_ef f ect_mode ' and an indicator of 
the period for the display effect 'display_ef f ect_period' . 

If the ' display__timing_mode * field is '0*, it indicates an 
automatic slide show. If the * display_timing_mode • field is '1', 

10 
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it indicates a browsable still or slideshow operation, which 
displays still images based on key input by a user. If the 
' display_order_mode ' field is *0*^ it indicates a sequential 
still operation rn which the still images are to be displayed 
5 sequentially. If the • display_order_mode ' field is *1\ it 
indicates a random still operation in which the still images are 
to be displayed in a random manner. 

The 'display_ef f ect_mode * indicates the effect to be 
applied to the still image such as cut-in/cut-out or 

10 fade-in/fade-out. The ' display_ef f ect_period ' field indicates 
the time duration for which the corresponding display effect is 
valid. The fields of 'display_timing_mode ' , ' display_order__mode * , 
'display_ef fect_mode* and 'display_ef fect_period' can be defined 
and managed for each still image, 

15 In the case where a plurality of still images are linked, 

the ' ref_to_still_index' field indicative of the index number of 
a still image is defined as the index number of the last still 
image or the number of linked still images. If only one still 
image is linked, the " ref_to_still_index' is defined to be 

20 'OxFFFF'. 

As a further alternative, the embodiment of Fig. 7A may 
provided without including the ' ref_to_still_index ' field. 

Fig, 5B illustrates a method of managing still images in 
accordance with an exemplary embodiment of the invention that is 
25 the same as Fig. 5A, except that playlist marks may also be defined 
as movie marks. Movie marks are used for management of video 
presentation units (VPUs) . A prescribed recording block of a clip 
of an A/V stream wherein both video and audio data are recorded 
or only video data are recorded is assigned as a video presentation 
30 unit (VPU) . A VPU can be recorded and managed as a separate file. 
Navigation information may be recorded and managed so as to 
display a still image or video of a VPU at a particular position 
where display of a slideshow is desired, for example, such as in 

11 
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the middle of displaying motion video. 

Fig. 7B illustrates an exemplary embodiment of the 
navigation information for still images and VPUs provided by 
associated playlist marks. This embodiment is the same as Fig. 
5 7A, except that if the mark is a movie mark (e.g. , mark type =0x11) 
then additional information regarding the reproduction of a VPU 
is provided in association with the movie mark. Specifically, the 
following indicator fields are provided: 'VPU_Clip_f ile_name' to 
provide the clip file name of the VPU, the ^VPU_start_TM' and 
10 'VPU_end_TM' information to select and play the specified 
recording block of the VPU, 'VPU_data_size' information to 
indicate of the data record size of the VPU, and 'VPU_info' to 
provide information about the attributes of video data recorded 
in the VPU. 

15 Fig. 7C illustrates another example embodiment of the 

playlist mark information field. As shown, this embodiment is the 
same as the embodiment of Fig. 7B except the navigation information 
for still images is not included. 

Fig. 8A illustrates another exemplary embodiment of a method 

20 of managing still images according to the present invention. In 
this embodiment, navigation information such as the display time 
and display method of a still image or a group of still images 
are provided by one or more still indicators. As shown, a still 
indicator links one or a group of still images with a clip AV 

25 stream. The clip A/V stream may contain movie video and audio data 
together or only audio data. The still images may be stored in 
a single image file or each still image may be stored in an 
individual image file. 

As illustrated in Fig. 9A, the still indicator 

30 'PlayListStilllndicator' is a new information field added to a 
playlist file 'PlayList_File' . This new information field 
indicates a length of the information field and a number of the 
playlist stills *number_of_PlayList_stills' . For each playlist 

12 
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Still, the playlist indicator ' PlayListStilllndicator' 
information field indicates a time stamp ' still_time_stamp' , a 
start index number of the associated still image (s) recorded on 
the BD-ROM * ref_to_still_start_index' , and a number of still 
5 images *number_of_still__images . ' 

The time stamp ' still_time_stamp' of the playlist still 
indicates a point where the playlist still is placed; namely, 
indicates a point on a time axis of the A/V stream of clips (e.g. , 
ATC and/or STC basis) where the playlist still is placed. 

10 Furthermore, as shown in Fig. 9A, for each still image 

associated with a playlist still, the following information is 
provided: a duration ^duration' to display the still image, an 
indicator of the display timing *display_timing_mode' , an 
indicator of the display order 'display _order_mode' , an indicator 

15 of the display effect 'display_ef fect_mode' and an indicator of 
the period for the display effect *display_ef f ect_period' . These 
indicators were defined above with respect to Fig. 7A. 

Fig. 8B illustrates another exemplary embodiment of a method 
of managing still images and VPUs according to the present 

20 invention. In this embodiment, navigation information such as the 
display time and display method of a still image or a group of 
still images and/or VPUs are provided by one or more slideshow 
indicators. As shown, a slideshow indicator links one or a group 
of still images with a clip AV stream, or links a VPU with a clip 

25 AV stream. The clip A/V stream may contain movie video and audio 
data together or only audio data. The still images may be stored 
in a single image file or each still image may be stored in an 
individual image file. 

As illustrated in Fig. 9B, the slideshow indicator 

30 'PlayListSlideshowIndicator' is a new information field added to 
a playlist file ^PlayList_File' . This new information field 
indicates a length of the information field and a number of 
slideshow object ^number_of_slideshow_objects' . For each 

13 



wo 2004/023234 



PCT/KR2003/001801 



slideshow object, the slideshow indicator indicates a time stamp 
*still_time_stan\p' . The time stamp *still_time_stamp' indicates 
a point where the slideshow object is placed; namely, indicates 
a point on a time axis of the A/V stream of clips (e.g., ATC and/or 
5 STC basis) where the slideshow object is placed. 

If the slideshow object is a still image, a start index number 
of the associated still image (s) recorded on the BD-ROM 
'ref_to_still__start_index' , and a number of still images 
'number_of_still_images' are provided. Furthermore, as shown in 

10 Fig. 9B, for each still image associated with a playlist still, 
the following information is provided: a duration * duration' to 
display the still image, an indicator of the display timing 
'display_timing_mode' , an indicator of the display order display 
_order_mode' , an indicator of the display effect 

15 'display_ef f ect_mode' and an indicator of the period for the 
display effect *display_ef f ect_period' - These indicators were 
defined above with respect to Fig. 7A. 

If the slideshow object is a VPU, then the 
'VPU_Clip_f ile_name' information to identify the clip file of 

20 said VPU, 'VPU_start_TM' and WPU_end_TM' information to select 
and play the specified recording block of the VPU, ^VPU_data__size' 
information about data record size of the VPU, and WPU_info' 
information about the attributes of video data recorded in the 
VPU are included and recorded. 

25 Fig. 10 illustrates another exemplary embodiment of a method 

for managing still images according to the present invention. In 
this embodiment, playitems are used to manage one or more still 
images. For example, as shown, some playitems manage movie video 
and audio data or only audio data and some playitems manage a still 

30 image, a group of still images or slideshow (or portion of a 
slideshow), and have been labeled still playitems. 

The clip A/V stream corresponding to the playlist may contain 
movie video and audio data together or only audio data. The still 
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images may be stored in a single image file or each still image 
may be stored in an individual image file. The playitems of the 
playlist provide navigation information linking the still images 
and the clip A/V stream'; As will be appreciated^ the still images 
5 and, for example, the audio data are recorded in separate files 
and managed by separate files. In this manner, the still images 
and audio data may be reproduced together but independently. This 
permits, for example, continuously loop through (i.e., repeating) 
the clip of audio data linked with still images forming a slideshow 

10 while the still images are presented. 

Fig. IIA illustrates an exemplary embodiment of the playitem 
information field according to the present invention. The 
playitem * Playitem' information field indicates a length of the 
information field, and indicates the name of the clip information 

15 file 'Clip_Information_File_Name' associated with the playitem. 

The playitem information field also includes an indicator 
^Clip_codec-identif ier' indicating whether the playitem is a 
still playitem and associated with one or more still images. For 
example, the ' Clip_codec_identif ier ' field may indicate the 

20 encoding format of a still image such as 'JPEG' , which then serves 
to indicate that the playitem is a still playitem for still image 
display. 

If the CPI type given in the clip information file associated 
with the playitem is an EP map type signified by CPI type = 1, 
25 then the playitem includes an STC reference ^ref_to_STC-id' on 
the clip indicated by the clip information file name 
^Clip-Inf ormation_f ile_name' . 

The playitem also includes IN__time and OUT_time fields. The 
'IN_time' field takes up 2 bytes and indicates the index number 
30 of the first still image among the linked still images stored in 
the still image file and the *OUT-time* field indicates the index 
number of the last still image among the linked still images. 

Furthermore, as shown in Fig. IIA, if the playitem is a still 
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playitem, then the number of still images 'nuTT±>er_of_still_images ' 
is provided; and for each still image, the following information 
is provided: a duration 'duration to display the still image, an 
indicator' of the display timing *display_timing_mode' , an 
5 indicator of the display order 'display _order_mode' , an indicator 
of the display effect ' display_ef f ect_mode' and an indicator of 
the period for the display effect *display_ef f ectjperiod' . These 
indicators were defined above with respect to Fig. 7A. 

As will be appreciated, even though not shown in Fig. 10, a 

10 playitem may also serve as a VPU playitem. Fig. IIB illustrates 
an exemplary embodiment of a VPU playitem. Here, the clip codec 
identifier identifies the playitem as a VPU playitem, and provides 
the same VPU information discussed above with respect to movie 
marks and VPU slideshow objects. 

15 Fig. 12A illustrates another exemplary embodiment of a 

method for managing still images according to the present 
invention. In this embodiment, sub-playitems are used to manage 
one or more still images, while movie data (e.g., audio and video 
data) or only audio data is managed using playi terns. The 

20 sub-playitem indicates a sub-path in a playlist. 

In this method, a still image or a group of still images 
stored in a still image file is linked to a sub-playitem included 
in a playlist. The clip A/V stream corresponding to the playlist 
may contain movie video and audio data together or only audio data. 

25 The still images may be stored in a single image file or each still 
image may be stored in an individual image file. As will be 
appreciated, the still images and, for example, the audio data 
are recorded in separate files and managed by separate files. In 
this manner, the still images and audio data may be reproduced 

30 together but independently. This permits, for example, 

continuously loop through (i.e., repeating) the clip of audio data 
linked with still images forming a slideshow while the still 
images are presented - 
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Fig. 13A illustrates an exemplary embodiment of the 
sub-playitem information field according to the present invention. 
The sub-playitem ' SubPlayltem' information field indicates a 
length of the information field, and indicates the name' of the clip 
5 information file *Clip_Information_File_Name' associated with the 
sub-playitem. 

The sub-playitem information field also includes an 
indicator 'Clip_codec-identif ier' and a type indicator 
'SubPlayItem_type' both indicating whether the playitem is a still 

10 playitem and associated with one or more still images. For example, 
the 'Clip__codec_identifier ' field may indicate the encoding 
format of a still image such as 'JPEG', which then serves to 
indicate that the playitem is a still playitem for still image 
display. With respect to the type indicator ^SubPlayItem_type' , 

15 if the type indicator ^SubPlayItem_type' equals, for example, "2'', 
then this indicates the sub-playitem is associated with a sub-path 
for displaying one or more associated still images. 

The sub-playitem also includes IN_time and OUT_time fields. 
The 'IN_time' field takes up 2 bytes and indicates the index number 

20 of the first still image among the linked still images stored in 
the still image file and the 'OUT-time' field indicates the index 
number of the last still image among the linked still images. 

The sub-playitem further includes an STC reference 
'ref_to_STC_id' for the clip indicated by the clip information 

25 file name ^Clip-Information_f ile_name' , an id of the playitem 
containing this sub-playitem ^sync_Playitem__id' , and an 
indication ^Sync_start_PTS_of_PlayItem' of a presentation-time 
in the playitem indicated by the ^sync__Playitem_id. ' 

Furthermore, as shown in Fig. 13A, if the playitem is a still 

30 playitem, then the number of still images 'number_of_still_images' 
is provided; and for each still image, the following information 
is provided: a duration * duration' to display the still image, an 
indicator of the display timing 'display_timing_mode' , an 
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indicator of the display order 'display _order_mode' , an indicator 
of the display effect 'display_ef f ect_mode' and an indicator of 
the period for the display effect 'display_ef f ect jperiod' . These 
indicators were defined above with respect t~o Fig. 7A. 
5 In an alternative embodiment, the movie video and audio data 

or only audio is managed by a sub-playitem and the still image, 
images or slideshow (or portion thereof) is managed by a playitem. 
Fig, 12B illustrates an exenvplary embodiment of the present 
invention that is the same as the embodiment of Fig. 12A, except 

10 that a sub-playitem may also serve as a VPU sub-playitem to manage 
reproduction of a VPU. 

Fig 13B illustrates an exemplary embodiment of a sub-playitem 
according to the embodiment of Fig. 12B. As shown the sub-playitem 
embodiment of Fig. 13B is the same as the embodiment of Fig. 123, 

15 except that if the clip codec identifier and/or sub-playitem type 
indicator indicate the sub-playitem is a VPU sub-playitem, then 
the sub-playitem further indicates the size of the VPU and 
information about the attributes of video data recorded in the 
VPU. For example, with respect to the type indicator 

20 'SubPlayItem_type' , if the type indicator 'SubPlayItem_type' 
equals, for example, "3", then this indicates the sub-playitem 
is associated with a sub-path for displaying a VPU. 

Next, embodiments of a method for recording still 
information packets for allowing detection of still display 

25 positions will be described in detail. Fig. 14A illustrates a 
method of recording still information packets for identifying 
still image display positions in accordance with one embodiment 
the present invention. In this method, source packets recorded 
at still display start and still display end positions contained 

30 in the clip A/V stream, which is pointed to by at least one type 
of navigation information among still marks, still indicators, 
still playitems, and sub-playitems, are defined as still 
information packets for identifying groups of still images . 
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A still information packet comprises a 4-byte TP (transport 
packet) extra header and a 188-byte MPEG2 TP (transport packet) . 
The MPEG2 TP further comprises a packet header and a payload. As 
depicted in Fig. 14A, the still information including fields of 
5 ' still_start_end_f lag ' , 'number_of_images * , and ' display_inf o ' 
recorded in the payload. 

For example, if the ' still_start_end_f lag ' field is '0*, it 
indicates the still display start position. If this field is '1', 
it indicates the still display end position. The 
10 'number_of_images ' field is only meaningful at the display start 
position and ' display_inf o ' field stores the display order, the 
display effect, and the display effect period, etc. 

If the decoding operation in a VDP system such as shown in 
Fig. 16 detects a source packet having still information, that 
15 is, a still information packet while playing movie video and/or 
audio data recorded in the clip A/V stream, the optical disk 
reproducing apparatus displays the still image after stopping 
playing of the movie video data or displays the still image with 
playing audio data. 
20 Referring to the ' still_start_end_f lag ' , the VDP system 

starts or stops display of the still image. Two different types 
of packets, a still start packet and a still end packet, may be 
recorded at the still display start and end positions, 
respectively. 

25 Fig. 14B illustrates a method of recording slideshow 

information packets for identifying slideshow display positions 
in accordance with one embodiment the present invention. In this 
method, source packets recorded at slideshow display start and 
slideshow display end positions contained in the clip A/V stream, 

30 which is pointed to by at least one type of navigation information 
among playlist marks, still indicators, slideshow indicators, 
playitems, and sub-playitems, are defined as slideshow 
information packets for identifying groups of still images. 
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A slideshow information packet comprises a 4-byte TP 
(transport packet) extra header and a 188-byte MPEG2 TP (transport 
packet) . The MPEG2 TP further comprises a packet header and a 
payload. As depicted in Fig. 14B, the slideshow information 
5 include the field of ' slideshow_start__end_f lag * , the fields of 
' number_of_images ' , and ' display_inf o • if the slideshow 
information packet is a still image information packet, and the 
fields of duration of the VPU and data size of the VPU if the 
slideshow information packet is a VPU information packet. 

10 If the decoding operation in a VDP system such as shown in 

Fig, 16 detects a source packet having slideshow information, that 
is, a slideshow information packet while playing movie video 
and/or audio data recorded in the clip A/V stream, the optical 
disk reproducing apparatus displays the still image or VPU after 

15 stopping playing of the movie video data or displays the still 
image with playing audio data. 

Referring to the • still_start_end_f lag ' , the VDP system 
starts or stops display of the still image. Two different types 
of packets, a still start packet and a still end packet, may be 

20 recorded at the still display start and end positions, 
respectively. 

Fig. 15 illustrates a method of recording still information 
packets for identifying still image display positions in 
accordance with another embodiment of the invention. In this 
25 method, still information packets are added to display positions 
of all the still images contained in the clip A/V stream, which 
is pointed to by the navigation information employing at least 
one type among still marks, still indicators, still playitems, 
or sub-playitems . In this embodiment, still images can be detected 
30 by the still information packets. 

As described above, the still information packet contains 
still information including the fields of ' still_start_end_f lag ' 
and 'display_info* . The ' display_inf o ' field includes the display 
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order, the display effect, and the display effect period, etc. 

If the decodihg operation in a VDP system such as shown in 
Fig. 16 detects a source packet having the still information, that 
is, a "still information packet while playing movie video 'and/or 
5 audio data recorded in the clip A/V stream, the optical disk 
reproducing apparatus displays the still image after stopping 
playing of the movie video data or displays the still image with 
playing audio data. 

The still information packet may be added to both the still 

10 image start and end positions. Referring to the 

' still_start__end_f lag' , the VDP system starts or stops display 
of the still image. Two different types of packets, a still start 
packet and a still end packet, may be recorded at the still display 
start and end positions, respectively. 

15 An optical disk reproducing apparatus outputs movie data and 

still images or audio data and still images to, for example, a 
connected television set by referring to navigation information 
according to the present invention such as still marks, still 
indicators, slideshow indicators, still playitems, and 

20 sub-playitems . Fig. 16 illustrates a schematic diagram of an 
embodiment of an optical disk recording and reproducing apparatus 
according to the present invention. As shown, an AV encoder 9 
receives and encodes data (e.g. , movie video and audio data, only 
audio data, and/or still image data) . The AV encoder 9 outputs the 

25 encoded data along with coding information and stream attribute 
information. A multiplexer 8 multiplexes the encoded data based 
on the coding information and stream attribute information to 
create, for example, an MPEG- 2 transport stream. A source 
packetizer 7 packetizes the transport packets from the multiplexer 

30 8 into source packets in accordance with the audio/video format 
of the optical disk. As shown in Fig. 14, the operations of the 
AV encoder 9, the multiplexer 8 and the source packetizer 7 are 
controlled by a controller 10. The controller 10 receives user 
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input on the recording operation, and provides control information 
to AV encoder 9, multiplexer 8 and the source packetizer 7. For 
example, the controller 10 instructs the AV encoder 9 on the type 
of encoding to perform, instructs the multiplexer 8 on the 
5 transport stream to create, and instructs the source packetizer 
7 on the source packet format. The controller 10 further controls 
a drive 3 to record the output from the source packetizer 7 on the 
optical disk. 

The controller 10 also creates the navigation and management 

10 information for managing reproduction of the data being recorded 
on the optical disk. For example, based on information received 
via the user interface (e.g., instruction set saved on disk, 
provided over an intranet or internet by a computer system, etc.) 
the controller 10 controls the drive 3 to record one or more of 

15 the data structures of Figs. 1-15 on the optical disk. 

During reproduction, the controller 10 controls the drive 3 
to reproduce this data structure. Based on the information 
contained therein, as well as user input received over the user' 
interface (e.g., control buttons on the recording and reproducing 

20 apparatus or a remote associated with the apparatus) , the 

controller 10 controls the drive 3 to reproduce the data from the 
optical disk. For example, as discussed above with respect to the 
embodiments of the present invention, a still image or still images 
may be reproduced in association with movie video and audio data 

25 or only audio data based on the navigation information. Furthermore, 
an image or group of images may be reproduced as a slideshow or 
portion of a slideshow. As also discussed, a slideshow may be 
synchronized, browsable, etc. 

The reproduced source packets are received by a source 

30 depacketizer 4 and converted into a data stream (e.g., an MPEG-2 
transport packet stream) . A demultiplexer 5 demultiplexes the data 
stream into encoded data. An AV decoder 6 decodes the encoded data 
to produce the original data that was feed to the AV encoder 9. 
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During reproduction, the controller 10 controls the operation of 
the source depacketizer 4, demultiplexer 5 and AV decoder 6. The 
controller 10 receives user input on the reproducing operation, 
and provides control information to AV decoder 6, demultiplexer 
5 5 and the source packetizer 4. For example, the controller 10 
instructs the AV decoder 9 on the type of decoding to perform, 
instructs the demultiplexer 5 on the transport stream to 
demultiplex, and instructs the source depacketizer 4 on the source 
packet format . 

10 While Fig. 16 has been described as a recording and 

reproducing apparatus, it will be understood that only a recording 
or only a reproducing apparatus may be provided using those 
portions of Fig, 16 providing the recording or reproducing 
function. 

15 Next, some of the different types of slideshows will be 

described in detail with reference to Figs. 17-20. It will be 
appreciated that these are merely examples, and the data structure 
of the present invention provides for other types of slideshows. 
Figs. 17-19 illustrate examples of synchronized or 

20 time-based slideshows. In this example, the display items (VPUs 
and/or still items) are displayed at a particular point in time. 
In the examples of Figs. 17-19, the display items are displayed 
at particular points in time in synchronization with the audio 
data reproduced from a clip A/V stream. The presentation time and 

25 duration of each display item are provided by the navigation 
information in a playlist. For example, the navigation 
information includes one or more of a playlist mark, still or 
slideshow indicator, playitem and sub-playitem as described in 
detail above. The navigation information for the audio data is 

30 supplied by one of a playitem and sub-playitem in the playlist. 
The navigation information may further indicate whether a 
sequential or random playback should occur. 

Fig. 17 illustrates an example of sequential synchronized 
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playback. Here, the seven display items Display #l-#7, which 
include VPUs #1 and #2 and still items #l-#5, are displayed at 
the presentation times indicated with respect to each display 
item. 

5 Fig. 18 illustrates an example of random playback of the 

seven display items Display #l-#7. Here, the VDP system obtains 
the presentation time for each display item from the navigation 
information, but randomly picks which display item to display at 
each obtained presentation time. Fig. 19 illustrates an example 

10 where a first portion of playback is sequential and a second 
portion of playback is random. 

Fig. 20 illustrates an example of a browsable slideshow. In 
a browsable slideshow, each display item is displayed until user 
input is received that indicates to change from the displayed 

15 display item. With a browsable slideshow, the navigation 

information indicates the duration of, for example, a still image 
as infinite. The user input received may indicate to proceed to 
a next .display item or a previous display item. When a browsable 
slideshow is reproduced with audio data as shown in Fig. 20, no 

20 synchronization exists between the audio data and the display 
items. Instead, the audio data is continuously and repeatedly 
reproduced during the slideshow. As further shown with respect 
to VPU #1, if a VPU is reproduced as a display item, and 
reproduction of the VPU completes before user input to change the 

25 display item is received, then the last picture of the VPU is 
maintained as a still image. As with time-based slideshows, the 
display of display items may be sequential or random. Fig. 20 
illustrates a sequential browsable slideshow. 

Next, a more detail description of reproducing a browsable 

30 slideshow based on the navigation information will be described. 
As discussed, a browsable slideshow may be reproduced based on 
playlist marks defined as still marks. In this example, the 
controller 10 reproduces a playlist, and based on the navigation 
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information in the playlist, the controller 10 reproduces a still 
image along with, for example, only audio data. The playlist 
provides navigation information, for example, a playitem or 
sub-playite*m, for the audio data and provides a still mark linking 
5 the still image with the audio data. The controller 10 causes output 
of the still image until user input instructing the controller 10 
to skip to the next or previous still image is received. The 
controller 10 then reproduces the next or previous still image. 
This next or previous image may be the next or previous image in 

10 a group of images referred to by the still mark, or may be the still 
image referred to by the next or previous still mark in the playlist. 
This same browsable slideshow operation may be performed based on 
still indicators. 

A browsable slideshow may also be reproduced based on the 

15 playitems or sub-playitems defined as still playitems or 

sub-playitems . Here, the controller 10 reproduces, for example, 
only audio data referenced by a non-still playitem or sub-playitem 
in the playlist, and reproduces a still image or one still image 
in a group of still images referenced by a still playitem or 

20 sub-playitem in the playlist. The controller 10 causes output of 
the still image until user input instructing the controller 10 to 
skip to the next or previous still image is received. The controller 
10 then reproduces the next or previous still image. This next or 
previous image may be the next or previous image in a group of images 

25 referred to by the current still playitem or still sub-playitem, 
or may be the still image referred to by the next or previous still 
playitem or still sub-playitem in the playlist. 

As will be appreciated from the forgoing disclosure, the 
present invention provides a recording medium having a data 

30 structure for managing still images recorded on a high-density 
recording medium (e.g., a high-density optical disk such as a 
BD~ROM) . For example, the data structure allows for displaying 
movie video and still images or audio and still images in various 
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ways . 

As apparent from the above description, the present invention 
provides methods and apparatuses for recording a data structure 
on a high density recording medium for managing stilT images 
5 recorded on the recording medium. 

The above description further provides methods and apparatus 
for reproducing still images recorded on a high density recording 
medium based on a data structure, also recorded on the high density 
recording medium, for managing the reproduction of still images. 

10 While the invention has been disclosed with respect to a 

limited number of embodiments, those skilled in the art, having 
the benefit of this disclosure, will appreciate numerous 
modifications and variations there from. For example, while 
described with respect to a Blu-ray ROM optical disk in several 

15 instances, the present invention is not limited to this standard 
of optical disk or to optical disks. It is intended that all such 
modifications and variations fall within the spirit and scope of 
the invention. 
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CLAIMS 

1 . A recording medium having a 'data' structure for managing 
reproduction of a slideshow of still images recorded on the 
recording medium, comprising: 

5 a playlist area storing a playlist file, the playlist file 

including navigation information for reproducing still images and 
audio data together as a slideshow. 

2. The recording medium of claim 1, wherein the navigation 
information links the still images and audio data such that 

10 presentation of the still images is synchronized with reproduction 
of the audio data. 

3. The recording medium of claim 1, wherein the navigation 
information links the still images and audio data such that 
reproduction of the audio data occurs independently of 

15 presentation of the still images. 

4. The recording medium of claim 1, wherein the navigation 
information indicates a duration to display each still image during 
reproduction of the slideshow 

5.. The recording medium of claim 5, when the duration is one 
20 of a finite and infinite display time. 

6. The recording medium of claim 5, wherein an infinite 
display time duration for a still image in the slideshow indicates 
to display the still image until user input instructing a change 
from the still image is received. 
25 7. The recording medium of claim 1, wherein the navigation 

information indicates whether progress of the slideshow from one 
still image to another still image is controlled by user input. 

8. The recording medium of claim 7, wherein the navigation 
information provides information for skipping to one of a next and 
30 a previous still image from reproduction of at least one still image 
when the navigation information indicates that progress of the 
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slideshow from one still image to another still image is controlled 
by user input . 

9. The recording medium of claim 1, wherein one of a playitem 
field and a sub-playitem' field provides at least a portion of the 
5 navigation information. 

10 . The recording medium of claim 9 , wherein one of a playitem 
field and a sub-playitem field provides navigation information for 
the still images and a different one of a playitem field and a 
sub-playitem field provides navigation information for the audio 
10 data. 

11. The recording medium of claim 10, wherein the playlist 
further includes mark information, and the mark information 
includes a mark pointing to the still picture. 

12. The recording medium of claim 9, wherein the playlist 
15 further includes mark information, and the mark information 

includes a mark pointing to the still picture. 

13. The recording medium of claim 1, wherein the playlist 
further includes mark information, the mark information includes 
a mark pointing to the still picture . 

20 14. The recording medium of claim 1, further comprising: 

a data area storing at least a portion of the still images 
in a first file and audio data in a second file; and wherein 
the playlist links the first and second files. 

15. A method of reproducing a slideshow, comprising: 

25 reproducing a slideshow of still images and audio from a 

recording medium based on navigation information reproduced from 
a playlist file recorded on the recording medium. 

16. An apparatus for reproducing a slideshow, comprising: 
a driver for driving an optical reproducing device to 

30 reproduce data recorded on the recording medium; 

a controller configured to control the driver to reproduce 
a slideshow of still images and audio data from a recording medium 
based on navigation information reproduced from a playlist file 
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recorded on the recording medium. 

17. A method of recording a data structure for managing 
reproduction of a slideshow of still images recorded on the 
recording medium, comprising: 

5 recording a playlist file in a playlist area of the recording 

medium, the playlist file including navigation information for 
reproducing still images and audio data together as a slideshow. 

18. An apparatus for recording a data structure for managing 
reproduction of a slideshow of still images recorded on the 

10 recording medium, comprising: 

a driver for driving an optical recording device to record 
data on the recording medium; 

an encoder for encoding at least multiple reproduction path 
video data; and 

15 a controller for controlling the driver to record a playlist 

file in the playlist area of a recording medium, the playlist file 
including navigation information for reproducing still images and 
audio data together as a slideshow. 



29 



wo 2004/023234 



PCT/KR2003/001801 



1/26 



c 



Root 



3 



BD 



FIG. 1 



f PLAYLIST 



- T CLIPINF 



- f STREAM 



OlOOl.mpIs 



02002.mpl5 



01 001 .dpi 



OlOOO.clpi 



03000.clpi 



01001.m2ts 



02000.m2ts 



03000.iii2ts 



wo 2004/023234 



2/26 



PCT/KR2003/001801 



CM 

d 




i 



a 

o 

o <^ 



CO 



N 



wo 2004/023234 



PCT/KR2003/001801 



3/26 




wo 2004/023234 



PCT/KR2003/001801 




wo 2004/023234 



5/26 



PCT/KR2003/001801 




wo 2004/023234 PCT/KR2003/001801 

6/26 




wo 2004/023234 PCT/KR2003/001801 

7/26 



FIG. 6 

Caes 1 :, 

PlayLi$tMarkO{ 
length 

n u mber_of_PlayList_marks 

for(i=0; j<number_of_PlayList_marks;j++){ 

markjtype 



inark.time_stamp 



refjtojstiUJlmageJtndex 
duration 

makers_infomiation 

maker^name 

} 

} 



Caes 2 FIG. 7A 

PIayListMarkO{ 
length 

number_of_PlayList__inarks 

for(i=0; j<number_of_PIayList_marks;j-i-+){ 

markjtype 
mark_time_stainp 



refJojstUlJimageJindex 
duration 

makersjnforination 

maker^name 

if(markjtype=Oxl 0)f 

number_of__still_images 
display_timing_mode 
display jorderjmode 
display_effect_m ode 
displayjeffect jeriod 
} 

} 



wo 2004/023234 



PCT/KR2003/001801 



8/26 



FIG. 7B 



Movie & Still Mark 



PlayListMarkOI' 
length 

D u mber_of_PIayList_ina rks 

for(i='0; j<nuinber_of_PIayList_marks;j++){ 



markjtype 
inark_time_stanip 



ref_to_stillJtmagejtndex 
duration 

makersJnformatioD 

maker name 

if(mafRjype^OxlO){ 

number of stul_images 
displayjtirningjmode 
display_orderjntode 
display_effect mode 
displayjRjfecTj^Tiod 

if {mark type == OxUH 

VPif Clip file name 

VPlTstarTTM: 

VPlTendTM 

VPlFdata size 
^ VPUZinfa- 



FIG. 7C 



Movie Mark 



PlayListMarkO{ 
length 

number_of_PlayList_inarks 

for(i=0; j<nuinber_of_Play List_inarks; j++) { 



markjtype 



inark_tiine_stanip 



duration 

makersjnformation 
maker name 

} 

if (markjtype == 0x1 l)f 
yPU^ClipJile^name 
VPU_startJTM 
yPU__end_TM 
VPU_data_size 

^ VPUJnfo 



wo 2004/023234 



9/26 



PCT/KR2003/001801 




wo 2004/023234 



10/26 



PCT/KR2003/001801 




wo 2004/023234 



11/26 



PCT/KR2003/001801 



PIayList_FileO{ 



vesion number 



PlayListO 
PlayListMarkO 
MakersPrivateDataO 
PlayListSmilndicatorO •- 
} 



FIG. 9A 



PlayListSmindicatorO 
length 

number_ofJPlayList_stills 

for(stiUJd^O; smi_id<number_of_PlayListJStill;sMn^ 



stilljtime_stamp 
refjtostill_start_index 
numberjof_jtiUJtmages 
for(i-0; i<number_of_stiU_imagesi/++)f 
duration 

displayjtiming_m ode 
display_order_mode 
display jeffect_mode 
display^effect jferiod 



wo 2004/023234 



12/26 



PCT/KR2003/001801 



PlayLlst_FiIeO{ 
version number 



PlayListO 
PlayListMarkQ 
MakersPrivateDataQ 
PlayListSlideshowIndicatorO 
} 



FIG. 9B 



^PlayListSlideshowIndicatorO 
length 

numberof_slideshow_objects 
for(id=0; id<numberjof_slideshow_objects;id'^){ 

time_stamp 
if(Stm Image) 

refjto_still_start_index 
numberjof^stilljimages 
for(i=0; i<number_ofjstillJtmages;i'^){ 
duration 

displayjdmingjmode 
display_order_mode 
displayjeffedjntode 
display_effeci jperiod 

} 

} 

elseiffVPU){ 

VPUjduration 
VPU_Clip Jile_name 
VPU_start_PTM 
VPU_end_PTM 
VPU_data_size 
VPUJnfo 

} 



wo 2004/023234 



PCT/KR2003/001801 



13/26 




wo 2004/023234 



PCT/KR2003/001801 



14/26 



FIG. 11A 
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